In the Claims: 



Following is a complete set of claims as amended with this Response. 



1 . \ (Currently Amended) A method of processing video data comprising the 
steps of: 

accepting video frame data from a video source; [and] 

accepting [storing! video information regarding [associated with] the video frame 
data [as the viddo data is being accepted,]; 

comparing a current state of the video information with gathered video 
information regarding the video frame data; 

determining differential information based on the comparing; and 

storing the differential information [the video information being stored] as 
annotations to the video frame data. - 

2. The method of claim 1, wherein the video information comprises camera 
geometry informatioi 

3. The method of claim 1, wherein the video information comprises camera 
pose information. 

4. The method of claim 1, wherein the video information comprises source 
identification/description/illumination information. 

5. The method of claim 1, wherein the video frame data comprises images 
obtained from a camera! [frame data obtained from an encoder], 

6-7. (Canceled) 

8. (Currently Amended) The method of claim 1. wherein comparing 
comprises [7, further comprising] comparing a_[the] current state with [the] camera 
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geometry information, [the] camera pose information and [the] source 
identiffication/description/illumination information of the video frame data. 
y. (Canceled) 

10. (Currently Amended) The method of claim h wherein storing comprises 
[9, further comprising] appending the differential information to the video frame data. 
1 1\ (Currently Amended) An apparatus comprising: 
a vmeo source to generate video frame data; 

a collector configured to collect video information to be associated with the video 
frame data [mthered from a video source]; [and] 

a comparator to compare a current state of the collected video information with 
collected videoynformation; 

a differential generator to determine differential information based on the 
comparison; and \ 

an annotatpr coupled to the differential generator [collector, the annotator 
configured] to annotate the video frame data with the differential [video] information. 

12. The apparatus of claim 11, wherein the video information comprises one 
or more of: camera geometry; camera pose information; and source 
identification/descrintion/illumination information. 

13. (Currently Amended) The apparatus of claim 12, further comprising 
calibration software dpnfigured to generate the camera geometry information for the 
video frame data as toe video frame data is being gathered by the video source and 
provide the generated camera geometry information to the collector. 

14. (Currently Amended) The apparatus of claim 12, further comprising pose 
estimation software [ana] configured to generate the camera pose information for the 
video frame data as the video frame data is being gathered by the video source and 
provide the generated camera pose information to the collector. 
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15. (Currently Amended) The apparatus of claim 12, further comprising an 
encoder cdupled to the differential generator configured to encode the differential 
informatiqn [video data and generate frame data] as an input to the annotator. 

1 6. \ (Currently Amended) The apparatus of claim 1 5, wherein the encoder 
forwards' a Current state of the video information [frame data] to a state storage device 
coupled to the encoder. 

17-19\ (Canceled) 

20. YCurrently Amended) The medium [computer readable media] of claim 29 
[19], wherein the video information is camera geometry information. 

2 1 . (Currently Amended) The medium [computer readable media] of claim 29 
[19], wherein theWideo information is camera pose information. 

22. (Currently Amended) The medium [computer readable media] of claim 29 
[19], wherein the v\deo information is source identification/description/illumination 
information. 

23. (Canceled) 

24. (CuirerMy Amended) The medium [computer readable media] of claim 29 
[19], wherein the videolsource is a video capture device. 

25-27. (Canceled) 

28. (Currently Amended) The medium [computer readable media] of claim 29 
wherein the instructions ror storing comprise instructions which, when executed by the 
machine, cause the machine to perform further operations comprising [27. further 
comprising] appending the Differential information to the video frame data. 

29. (New) A machine-readable medium having stored thereon data 
representing instructions whieh, when executed by a machine, cause the machine to 
perform operations comprising: 

accepting video frame data from a video source; 
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a&cepting video information regarding the video frame data; 
comparing a current state of the video information with gathered video 
information regarding the video frame data; 

determining differential information based on the comparing; and 
storing the differential information as annotations to the video frame data. 

30. YNew) An annotated video bitstream comprising: 
video irrkge data; and 

video processing data regarding the video image data, annotating the video image 
data, for subsequent video processing. 

3 1 . (New) The bitstream of Claim 30, wherein the video processing data 
comprises camera pose information, camera geometry information and source 
identification information. 

32. (New) The bitstream of Claim 3 1 , wherein the camera geometry 
information is defined by a camera projection matrix. 

33. (New) The bitstream of Claim 30, wherein the video processing data 
comprises information fyr constructing three-dimensional models of objects in a scene of 
the video image data. 

34. (New) Thd bitstream of Claim 30, wherein the video processing data 
comprises a three-dimensipnal scene model of objects in a scene of the video image data. 

35. (New) The bitstream of Claim 30, wherein the video processing data 
comprises differential information indicating differences between video processing data 
for successive video image frames. 

36. (New) The bitstream of Claim 30, wherein the video processing data is 
present only for video imageurames for which differential information exists. 
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